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(54) Image predictive coding and decoding method and apparatus 



(57) Disclosed is an image predictive decoding 
method in which image data obtained by compressively 
coding a variable-size image using a prescribed method 
is input, a prediction image is generated using, as a rel- 
erence image, at least one reproduced image which has 
been reproduced before an image being an object of 
decoding, and the object image is subjected to predic- 
tive decoding. In this method, the prediction image is 
generated using, as a reference image, at least one 
reproduced image which has been recently reproduced 
and includes significant image data to be referred to. 
Therefore, when plural objects constituting an image 
are subjected to compressive coding and transmitted 
object by object to increase the compression efficiency, 
it is avoided that a variable-size image which has 
already disappeared is used as the reference image for 
predictive decoding. As a result, coded data obtained by 
efficient compressive coding that suppresses the code 
quantity can be appropriately decoded. 
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Description 

FIELD OF THE INVENTION 

The present invention relates to image predictive 
decoding and image predictive coding and, more partic- 
ularly, to image predictive decoding methods, image 
predictive decoding apparatuses, image predictive cod- 
ing methods, image predictive coding apparatuses, and 
data storage media, which are used for processing var- 
iable-size images. 

BACKGROUND OF THE INVENTION 

In order to store or transmit a digital image with high 
efficiency, it is necessary to compressively code the dig- 
ital image. As a typical method for compressive coding 
of a digital image, there is DCT (Discrete Cosine Trans- 
formation) represented by JPEG (Joint Photographic 
Experts Group) and MPEG (Moving Picture Experts 
Group). Besides, there are waveform coding methods 
such as sub-band coding, wavelet coding, and fractal 
coding. Further, in order to eliminate a redundant signal 
between images, inter-image prediction using motion 
compensation is carried out, and a difference signal is 
subjected to waveform coding. 

Here, an MPEG method based on motion compen- 
sation DCT will be described. Initially, an input image of 
one frame to be coded is divided into plural macroblocks 
each having the size of 16x16 pixels. Each macroblock 
is further divided into four blocks each haying the size of 
8x8 pixels, and each block of 8x8 pixels is subjected to 
DCT and quantization. This process is called "intra- 
frame coding". 

On the other hand, using a motion detecting 
method such as block matching, from a frame temporar- 
ily adjacent to an object frame including an object mac- 
roblock to be quantized, a prediction macroblock having 
the smallest error from the object macroblock is 
detected, and motion compensation from the past 
image is carried out on the basis of the detected motion, 
thereby to obtain an optimum prediction block. A signal 
showing the motion toward the prediction macroblock 
having the smallest error is a motion vector. An image 
used as a reference for generating the prediction mac- 
roblock is called a reference image, hereinafter. There- 
after, a difference between the object block and the 
corresponding prediction block is obtained, and this dif- 
ference is subjected to DCT to obtain a DCT coefficient. 
The DCT coefficient is quantized, and the quantized 
output is transmitted or stored together with the motion 
information. This process is called "inter-frame coding". 

The inter-frame coding has two prediction modes: 
prediction from a previous image in the display order, 
and prediction from both of previous and future images. 
The former is called "forward prediction", and the latter 
is called "bidirectional prediction". 

On the decoder end, after restoring the quantized 



DCT coefficient to the original difference signal, the pre- 
diction block is obtained on the basis of the difference 
signal and the motion vector, and the prediction block 
and the difference signal are added to reproduce the 

5 image. In this conventional technique, it is premised that 
the size of the reference image (an image used as a ref- 
erence for generating a prediction image) is equal to the 
size of the object image. 

In recent years, plural objects constituting an image 

io (arbitrary shape images) are separately subjected to 
compressive coding and transmitted, thereby to 
improve the coding efficiency and to enable object by 
object reproduction. In coding and decoding of such 
arbitrary shape image, the size of the image changes 

is very often. For example, a ball becomes smaller and 
smaller, till at last it disappears. Further, there is a case 
where the size of the image (object) becomes zero. 

In ordinary predictive coding, a reference image is a 
reproduced image just before an object image which is 

20 currently being processed. When the size of the refer- 
ence image is zero, since nothing is defined in the refer- 
ence image, i.e., since the reference image has no 
significant image data to be used for predictive coding, 
predictive coding cannot be carried out. In this case, 

25 there is no conventional way except the intra-frame cod- 
ing. However, generally the intra-frame coding 
increases the quantity of coded data and reduces the 
compression efficiency. When an image disappears 
(image size = zero) and appears frequently in a 

30 sequence of motion picture, the coding efficiency is sig- 
nificantly degraded. For example, in a motion picture of 
flashing spotlight, when the light disappears and 
appears in image units, all the images of lights must be 
subjected to the intra-frame coding. 

35 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an 
image predictive decoding method, an image predictive 

40 decoding apparatus, an image predictive coding 
method, an image predictive coding apparatus, and a 
data storage medium, which can realize efficient predic- 
tive coding or decoding of a variable-size image even 
when the size of a reference image is zero or when the 

45 reference image is completely transparent. 

Other objects and advantages of the invention will 
become apparent from the detailed description that fol- 
lows. The detailed description and specific embodi- 
ments described are provided only for illustration since 

so various additions and modifications within the scope of 
the invention will be apparent to those of skill in the art 
from the detailed description. 

According to a first aspect of the present invention, 
there is provided an image predictive decoding method 

55 in which image data obtained by compressively coding 
a variable-size image using a prescribed method is 
input, a prediction image is generated using, as a refer- 
ence image, at least one reproduced image which has 
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beeh reproduced before an image being an object of 
decoding, and the object image is subjected to predic- 
tive decoding; wherein the prediction image is gener- 
ated using, as a reference image, at least one 
reproduced image which has been recently reproduced 5 
and includes significant image data to be referred to. In 
this method, when the size of the reference image 
(reproduced image) is zero, i.e., when the reference 
image is completely transparent, predictive decoding is 
carried out using another reproduced image of which 70 
size is not zero. Therefore, when plural objects consti- 
tuting an image are subjected to compressive coding 
and transmitted object by object to increase the com- 
pression efficiency, it is avoided that a variable-size 
image which has already disappeared is used as the ys 
reference image for predictive decoding. As a result, 
coded data obtained by efficient compressive coding 
that suppresses the code quantity can be appropriately 
decoded. 

According to a second aspect of the present inven- 20 
tion, there is provided an image predictive decoding 
method in which image data obtained by compressively 
coding a variable-size image using a prescribed method 
is input, a prediction image is generated using, as a ref- 
erence image, a prescribed image which has been 25 
reproduced before an image being an object of decod- 
ing, and the object image is subjected to predictive 
decoding; wherein, when the reproduced image used 
as a reference image has no significant coded data to 
be referred to, an image having a prescribed value as its 30 
image data is used as the prediction image. In this 
method, when the size of the reference image (repro- 
duced image) is zero, i.e., when the reference image is 
completely transparent, predictive decoding is carried 
out using a prediction image having a prescribed value. 35 
Therefore, in addition to the above-mentioned effects, 
generation of the prediction image is facilitated. 

According to a third aspect of the present invention, 
there is provided an image predictive decoding method 
in which image data obtained by compressively coding 40 
a variable-size image using a prescribed method is 
input, a prediction image is generated using a reference 
image, and an image being an object of decoding is 
subjected to predictive decoding; wherein the prediction 
image is generated using, as the reference image, at 45 
least one of two reproduced signals which have been 
recently reproduced, which one has significant image 
data to be referred to. Therefore, in the case where plu- 
ral objects constituting an image are subjected to com- 
pressive coding and transmitted object by object, when so 
a prediction image is generated using forward and back- 
ward reference images, it is avoided that variable-size 
images which have already disappeared are used as 
the reference images. As a result, coded data obtained 
by efficient compressive coding that suppresses the ss 
code quantity can be appropriately decoded. 

According to a fourth aspect of the present inven- 
tion, there is provided an image predictive decoding 



apparatus comprising input means to which image data 
obtained by compressively coding a variable-size image 
using a prescribed method is applied; a data analyzer 
which analyzes the image data and outputs the image 
size and the image transform coefficient; a decoder 
which restores the image transform coefficient to an v 
expanded difference image using a prescribed method; 
a frame memory that contains a reproduced image; a 
prediction image generator that generates a prediction 
image using, as a reference image, the reproduced 
image stored in the frame memory; and an adder that 
generates a reproduced image by adding the expanded 
difference image and the prediction image, and outputs 
the reproduced image and, simultaneously, stores the 
reproduced image into the frame memory; wherein the 
prediction image generator examines whether or not the 
reproduced image includes significant image data to be 
referred to. and generates a prediction image using, as 
a reference image, at least one reproduced image 
which has been recently reproduced and includes sig- 
nificant image data. In this apparatus, when the size of 
the reference image (reproduced image) is zero. i.e.. 
when the reference image is completely transparent, 
predictive decoding is carried out using another repro- 
duced image of which size is not zero. Therefore, when 
plural objects constituting an image are subjected to 
compressive coding and transmitted object by object to 
increase the compression efficiency, it is avoided that a 
variable-size image which has already disappeared is 
used as the reference image for predictive decoding. As 
a result, coded data obtained by efficient compressive 
coding that suppresses the code quantity can be appro- 
priately decoded. 

According to a fifth aspect of the present invention, 
there is provided an image predictive decoding appara- 
tus comprising input means to which image data 
obtained by compressively coding a variable-size image 
using a prescribed method is applied; a data analyzer 
which analyzes the image data and outputs the image 
size and the image transform coefficient; a decoder 
which restores the image transform coefficient to an 
expanded difference image using a prescribed method; 
a frame memory that contains a reproduced image; a 
prediction image generator that generates a prediction 
image using, as a reference image, a prescribed repro- 
duced image stored in the frame memory and corre- 
sponding to the input image; and an adder that 
generates a reproduced image by adding the expanded 
difference image and the prediction image, and outputs 
the reproduced image and, simultaneously, stores the 
reproduced image into the frame memory; wherein the 
prediction image generator examines whether or not the 
prescribed reproduced image has significant image 
data to be referred to, and when the reproduced image 
has no significant coded data to be referred to, an image 
having a prescribed value as its image data is used as 
the prediction image. In this apparatus, when the size of 
the reference image (reproduced image) is zero, i.e.. 
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when the reference image is completely transparent, 
predictive decoding is carried out using a prediction 
image having a prescribed value. Therefore, in addition 
to the above-mentioned effects, generation of the pre- 
diction image is facilitated. 

According to a sixth aspect of the present invention, 
there is provided an image predictive decoding appara- 
tus comprising input means to which image data 
obtained by compressively coding a variable-size image 
using a prescribed method is applied; a data analyzer 
which analyzes the image data and outputs the image 
size and the image transform coefficient; a decoder 
which restores the image transform coefficient to an 
expanded difference image using a prescribed method; 
a frame memory that contains a reproduced image; a 
prediction image generator that generates a prediction 
image using the reproduced image stored in the frame 
memory as a reference image; and an adder that gener- 
ates a reproduced image by adding the expanded differ- 
ence image and the prediction image, and outputs the 
reproduced image and, simultaneously, stores the 
reproduced image into the frame memory; wherein the 
prediction image generator generates the prediction 
image using, as the reference image, at least one of two 
reproduced signals which have been recently repro- 
duced, which one has significant image data to be 
referred to. Therefore, in the case where plural objects 
constituting an image are subjected to compressive 
coding and transmitted object by object, when a predic- 
tion image is generated using forward and backward 
reference images, it is avoided that variable-size images 
which have already disappeared are used as the refer- 
ence images. As a result, coded data obtained by effi- 
cient compressive coding that suppresses the code 
quantity can be appropriately decoded. 

According to a seventh aspect of the present inven- 
tion, there is provided an image predictive coding 
method in which a variable-size image is input, a predic- 
tion image is generated using, as a reference image, at 
least one reproduced image which has been repro- 
duced before an image being an object of coding, the 
object image is subtracted from the prediction image, 
and a difference between these images is compres- 
sively coded by a prescribed method; wherein the pre- 
diction image is generated using, as a reference image, 
at least one reproduced image which has been recently 
reproduced and includes significant image data to be 
referred to. In this method, when the size of the refer- 
ence image (reproduced image) is zero, i.e., when the 
reference image is completely transparent, predictive 
coding is carried out using another reproduced image of 
which size is not zero. Therefore, when plural objects 
constituting an image are subjected to compressive 
coding and transmitted object by object to increase the 
compression efficiency, it is avoided that a variable-size 
image which has already disappeared is used as the 
reference image for predictive coding, resulting in a pre- 
dictive coding method capable of efficient compressive 



coding that suppresses the code quantity. 

According to an eighth aspect of the present inven- 
tion, there is provided an image predictive coding 
method in which a variable-size image is input, a predic- 

5 tion image is generated using, as a reference image, a 
prescribed reproduced image which has been repro- 
duced before an image being an object of coding, the 
object image is subtracted from the prediction image, 
and a difference between these images is compres- 

10 sively coded by a prescribed method; wherein, when 
the reproduced image used as a reference image has 
no significant image data to be referred to, an image 
having a prescribed value as its image data is used as 
the prediction image. In this method, when the size of 

is the reference image (reproduced image) is zero, i.e., 
when the reference image is completely transparent, 
predictive coding is carried out using a prediction image 
having a prescribed value. Therefore, in addition to the 
above-mentioned effects, generation of the prediction 

20 image is facilitated. 

According to a ninth aspect of the present inven- 
tion, there is provided an image predictive coding 
method in which a variable-size image is input, a predic- 
tion image is generated using a reference image, an 

2$ object image being an object of coding is subtracted 
from the prediction image, and a difference between 
these images is compressively coded by a prescribed 
method; wherein the prediction image is generated . 
using, as the reference image, at least one of two repro- 

30 duced images which has been recently reproduced and 
includes significant image data to be referred to. There- 
fore, in the case where plural objects constituting an 
image are subjected to compressive coding and trans- 
mitted object by object, when a prediction image is gen- 

35 erated using forward and backward reference images, it 
is avoided that variable-size images which have already 
disappeared are used as the reference images, result- 
ing in a predictive coding method capable of efficient 
compressive coding that suppresses the code quantity. 

40 According to a tenth aspect of the present inven- 
tion, there is provided an image predictive coding appa- 
ratus comprising input means to which data of a 
variable-size image is input, which data is divided into 
units subjected to coding; a subtracter that obtains a dif- 

45 ference image between an object image being an object 
of coding and a prediction image corresponding to the 
object image; a compressive encoder that converts the 
difference image to compressed data by a prescribed 
compressive coding process; a variable-length encoder 

so that performs variable-length coding of the compressed 
data and outputs coded data; an expansive decoder 
that restores the compressed data to an expanded dif- 
ference image by a prescribed expansive decoding 
process; a frame memory that contains a reproduced 

55 image; a prediction image generator that generates a 
prediction image using the reproduced image stored in 
the frame memory as a reference image; and an adder 
that generates a reproduced image by adding the 
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expanded difference image and the prediction image, 
and outputs the reproduced image and, simultaneously, 
stores the reproduced image into the frame memory; 
wherein the prediction image generator examines 
whether or not the reproduced image has significant 
image data to be referred to, and generates the predic- 
tion image using, as a reference image, at least one 
reproduced image which has been recently reproduced 
and includes significant image data. In this apparatus, 
when the size of the reference image (reproduced 
image) is zero, i.e., when the reference image is com- 
pletely transparent, predictive coding is carried out 
using another reproduced image of which size is not 
zero. Therefore, when plural objects constituting an 
image are subjected to compressive coding and trans- 
mitted object by object to increase the compression effi- 
ciency, it is avoided that a variable-size image which has 
already disappeared is used as the reference image for 
predictive coding, resulting in a predictive coding appa- 
ratus capable of efficient compressive coding that sup- 
presses the code quantity. 

According to an eleventh aspect of the present 
invention, there is provided an image predictive coding 
apparatus comprising input means to which data of a 
variable-size image is input, which data is divided into 
units subjected to coding; a subtracter that obtains a dif- 
ference image between an object image being an object 
of coding and a prediction image corresponding to the 
object image; a compressive encoder that converts the 
difference image to compressed data by a prescribed 
compressive coding process; a variable-length encoder 
that performs variable- length coding of the compressed 
data and outputs coded data; an expansive decoder 
that restores the compressed data to an expanded dif- 
ference image by a prescribed expansive decoding 
process; a frame memory that contains a reproduced 
image; a prediction image generator that generates a 
prediction image using the reproduced image stored in 
the frame memory as a reference image; and an adder 
that generates a reproduced image by adding the 
expanded difference image and the prediction image, 
and outputs the reproduced image and, simultaneously, 
stores the reproduced image into the frame memory; 
wherein the prediction image generator examines 
whether or not the reproduced image has significant 
image data to be referred to and, when the reproduced 
image has no significant image data, an image having a 
prescribed value as its image data is used as the predic- 
tion image. In this apparatus, when the size of the refer- 
ence image (reproduced image) is zero, i.e., when the 
reference image is completely transparent, predictive 
coding is carried out using a prediction image having a 
prescribed value. Therefore, in addition to the above- 
mentioned effects, generation of the prediction image is 
facilitated. 

According to a twelfth aspect of the present inven- 
tion, there is provided an image predictive coding appa- 
ratus comprising input means to which data of a 



variable-size image is input, which data is divided into 
units subjected to coding; a subtracter that obtains a dif- 
ference image between an object image being an object 
of coding and a prediction image corresponding to the 

5 object image; a compressive encoder that converts the 
difference image to compressed data by a prescribed 
compressive coding process; a variable-length encoder 
that performs variable-length coding of the compressed 
data and outputs coded data; an expansive decoder 

w that restores the compressed data to an expanded dif- 
ference image by a prescribed expansive decoding 
process; a frame memory that contains a reproduced 
image; a prediction image generator that generates a 
prediction image using the reproduced image stored in 

75 the frame memory as a reference image; and an adder 
that generates a reproduced image by adding the 
expanded difference image and the prediction image, 
and outputs the reproduced image and, simultaneously, 
stores the reproduced image into the frame memory; 

20 wherein the prediction image generator generates the 
prediction image using, as the reference image, at least 
one of two reproduced signals which have been recently 
reproduced, which one has significant image data to be 
referred to. Therefore, in the case where plural objects 

25 constituting an image are subjected to compressive 
coding and transmitted object by object, when a predic- 
tion image is generated using forward and backward 
reference images, it is avoided that variable-size images 
which have already disappeared are used as the refer- 

30 ence images, resulting in a predictive coding apparatus 
capable of efficient compressive coding that sup- 
presses the code quantity. 

According to a thirteenth aspect of the present 
invention, there is provided an image predictive coding 

35 apparatus comprising input means to which data of a 
variable-size image is input, which data is divided into 
units subjected to coding; a subtracter that obtains a dif- 
ference image between an object image being an object 
of coding and a prediction image corresponding to the 

40 object image; a compressive encoder that converts the 
difference image to compressed data by a prescribed 
compressive coding process; a variable-length encoder 
that performs variable-length coding of the compressed 
data and outputs coded data; an expansive decoder 

45 that restores the compressed data to an expanded dif- 
ference image by a prescribed expansive decoding 
process; a frame memory that contains a reproduced 
image; a prediction image generator that generates a 
prediction image using the reproduced image stored in 

so the frame memory as a reference image; an adder that 
generates a reproduced image by adding the expanded 
difference image and the prediction image, and outputs 
the reproduced image and, simultaneously, stores the 
reproduced image into the frame memory; and a shape 

55 detector that detects whether the reproduced image 
includes significant image data to be referred to or not, 
on the basis of shape data showing the shape of an 
object and included in the variable-size image data; 
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wherein the prediction image generator receives an out- 
put from the shape detector and, when the reproduced 
image has no significant image data, the prediction 
image generator generates the prediction image using, 
as a reference image, at least one reproduced image 
which has been recently reproduced and includes sig- 
nificant image data. In this apparatus, when it is 
detected by the shape detector that the input shape sig- 
nal has a shape, the shape signal is subjected to predic- 
tive coding and, when the input shape signal has no 
shape, the shape signal is not subjected to predictive 
coding. Therefore, when plural objects constituting an 
image are subjected to compressive coding and trans- 
mitted object by object, it is avoided that a variable-size 
image which has already disappeared is used as a ref- 
erence image for predictive coding, resulting in a predic- 
tive coding apparatus capable of efficient compressive 
coding that suppresses the code quantity. 

According to a fourteenth aspect of the present 
invention, there is provided a data storage medium that 
contains a program for implementing a predictive 
decoding process by a computer, wherein the program 
is constructed so that the computer executes an image 
predictive decoding process according to any of the 
above-described image predictive decoding appara- 
tuses Therefore, it is possible to realize, by software, a 
predictive decoding process that can decode coded 
data obtained by efficient compressive coding that sup- 
presses the code quantity. 

According to a fifteenth aspect of the present inven- 
tion, there is provided a data storage medium that con- 
tains a program for implementing a predictive coding 
process by a computer, wherein the program is con- 
structed so that the computer executes an image pre- 
dictive coding process according to any of the above- 
described image predictive coding apparatuses. There- 
fore, it is possible to realize, by software, a predictive 
coding process capable of efficient compressive coding 
that suppresses the code quantity. 

According to a sixteenth aspect of the present 
invention, there is provided a data storage medium that 
contains a program for implementing a predictive coding 
process by a computer, wherein the program is con- 
structed so that the computer executes an image pre- 
dictive coding process according to any of the above- 
described image predictive coding apparatuses. There- 
fore, it is possible to realize, by software, a predictive 
coding process capable of efficient compressive coding 
that suppresses the code quantity. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a flowchart of a prediction image gener- 
ation process in an image predictive decoding method 
according to a first embodiment of the present inven- 
tion. 

Figures 2(a) and 2(b) are schematic diagrams for 
explaining image prediction in the image predictive 



decoding method according to the present invention. * 

Figure 3 is a block diagram illustrating an image 
predictive decoding apparatus according to the first 
embodiment of the invention. 
s Figure 4 is a block diagram illustrating a frame 

memory unit used in the image predictive decoding 
apparatus according to the first embodiment of the 
invention. 

Figure 5 is a flowchart of a prediction image gener- 
io ation process in an image predictive decoding method 
according to a third embodiment of the present inven- 
tion. 

Figure 6 is a flowchart of a prediction image gener- 
ation process in an image predictive decoding method 
75 according to a fourth embodiment of the present inven- 
tion. 

Figure 7 is a diagram showing image data accord- 
ing to the first embodiment of the invention. 

Figure 8 is a flowchart of a prediction image gener- 
ic ation process in an image predictive decoding method 
according to a second embodiment of the invention. 

Figure 9 is a diagram showing image data accord- 
ing to the second embodiment of the invention. 

Figure 10 is a flowchart of a prediction image gen- 
25 eration process in an image predictive decoding method 
according to a fifth embodiment of the present inven- 
tion. 

Figure 11 is a flowchart of a prediction image gen- 
eration process in an image predictive decoding method 
30 according to a sixth embodiment of the present inven- 
tion. 

Figure 12 is a block diagram illustrating an image 
predictive coding apparatus according to a seventh 
embodiment of the present invention. 

35 Figure 13 is a block diagram illustrating an image 
predictive coding apparatus according to an eighth 
embodiment of the present invention. 

Figures 14(a)-14(c) are diagrams for explaining a 
data storage medium which contains a program for 

40 implementing image processing by a computer, which 
image processing is one of the methods and appara- 
tuses according to the first to eighth embodiments of the 
invention. 

45 DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[Embodiment 1] 

so Figure 1 is a flowchart of a prediction image gener- 
ation process in an image predictive decoding method 
according to a first embodiment of the present inven- 
tion. Before explaining figure 1, an image prediction 
method according to this first embodiment will be 

55 described using figures 2(a) and 2(b). 

The size of an input image used in the image pre- 
dictive decoding method of this first embodiment is var- 
iable, and it may happen that the size becomes zero. 
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* Figure 2(a) shows images 201 -21 0 of a motion pic- 
ture, which are arranged in the display order. The image 
201 is the first frame to be displayed, followed by 202, 

203 and this order is shown by #1~#10. Since the 

image #1 (201) is the first image, it is subjected to intra- 
frame coding. In this first embodiment, an image (one 
frame) is divided into plural blocks each having the size 
of 8x8 pixels, and each block of '8x8 pixels is subjected 
to DCT and quantization. The quantized coefficient is 
subjected to variable-length coding. In decoding, the 
coded data obtained by the variable-length coding is 
subjected to variable-length decoding, and the quan- 
tized coefficient obtained by the variable-length decod- 
ing is subjected to inverse quantization and inverse 
DCT, thereby reproducing the image. Next, the image 
#2 (202) is subjected to inter-frame predictive coding by 
referring to the reproduced image #1 (201). 

In this first embodiment, using block matching as a 
motion detection method, a prediction block having the 
smallest error from the object block currently being 
processed is detected from the image #1 (201). On the 
basis of the detected motion from the object block 
toward the prediction block, an optimum prediction block 
is obtained by motion compensation of the object block 
from the reproduced image #1 (201). Next, a difference 
between the object block and the corresponding predic- 
tion block is obtained, and the difference is subjected to 
DCT. The DCT coefficient is quantized, and the quan- 
tized output is transmitted or stored together with the 
motion information. The reproduced image #1 (201) 
serves as a reference image for the image #2 (202). 
This prediction is called "forward prediction". In decod- 
ing, the prediction block is added to the difference which 
has been subjected to inverse quantization and inverse 
DCT, thereby reproducing the image. 

In like manner, the image #3 (203) and the image 
#4 (204) are subjected to predictive coding using refer- 
ence images shown by the arrows. Like the images #6 
(206), #8 (208) and #10 (210), prediction may be carried 
out from a previous image but one. In contrast with the 
forward prediction, like the images #5 (205), #7 (207) 
and #9 (209), prediction may be carried out by referring 
to a future image to be displayed after the object image. 
This prediction is called "backward prediction". When 
both the forward prediction and the backward prediction 
are carried out, this is called "bidirectional prediction". 
The bidirectional prediction has three modes: forward 
prediction mode, backward prediction mode, interpola- 
tion mode for balancing the forward prediction and the 
backward prediction. 

Figure 2(b) shows the transmission order, i.e.. 
decoding order, of the images predicted as shown in fig- 
ure 2(a). 

The image #1 (211) is initially decoded and repro- 
duced. Referring to the reproduced image #1 , the image 
#2 (212) is decoded. With respect to the bidirectional 
prediction image like the image #5 (216), the reference 
images used for the prediction have to be decoded and 



reproduced before the prediction image. Therefore, the 
image #6 (215) is decoded before the image #5 (216). 
Likewise, the image #8 (217) and the image #10 (219) 
are transmitted, decoded and reproduced before the 

5 image #7 (218) and the image #9 (220). respectively. 

When transmitting a variable-size image, the size of 
the image must be transmitted. In this first embodiment, 
the image size is described at the head of the coded 
data of the image, and the horizontal and vertical sizes 

io Hm and Vm are shown by 20 bits each. Figure 7 shows 
coded image data (VD) according to this first embodi- 
ment, and the coded data includes the motion vector, 
the quantization width, and the DCT coefficient, in addi- 
tion to the horizontal and vertical sizes Hm and Vm. 

15 Next, a description is given of the prediction image 
generation process in the image predictive decoding 
method according to the first embodiment. 

In order to generate a prediction image, initially, the 
size of the previous reference image is input (step 102), 

20 and it is examined whether the size of the reference 
image is zero or not (step 103). 

In the decoding order shown in figure 2(b), a refer- 
ence image always exists before an image being an 
object of decoding (in coding, an object of coding) That 

25 is, the reference image is a most recently reproduced 
image in the predictive decoding method of this first 
embodiment. For example, in figure 2(b), a reference 
image for the image #4 (214) is the image #3 (213). 
However, an image reproduced by bidirectional predic- 

30 tion cannot be used for prediction, so that this image 
cannot be a reference image. Therefore, for example, a 
reference image for the image #8 (21 7) is the image #6 
(215). 

When it is decided in step 103 that the size, of the 

35 reference mage is not zero, step 104 follows, wherein a 
prediction image is generated using the reference 
image. On the other hand, when it is detected in step 
103 that the size of the reference image is zero, step 
105 follows, wherein a prediction image is generated 

40 using, as a reference image, a recently reproduced 
image of which size is not zero. The way of detecting a 
recently reproduced image of which size is not zero will 
be described hereinafter using figure 2(b). 

In the case of generating a prediction image of the 

45 image #4 (214), it is assumed that the size of the image 
#3 (213) just before the image #4 (214) is zero, and the 
size of the image #2 is not zero. In this case, a predic- 
tion image of the image #4 (214) is generated by refer- 
ring to the image #2 (212). Likewise, in the case of 

so generating a prediction image of the image #6 (215), 
assuming that the sizes of the images #3 (213) and #4 
(214) are zero, the prediction image is generated by 
referring to the image #2 (212). This first embodiment 
employs block by block motion compensation as a 

55 method for generating a prediction image, like MPEG1. 
Figure 3 is a block diagram illustrating an image 
predictive decoding apparatus 300 according to the first 
embodiment of the invention. 
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The image predictive decoding apparatus 300 
receives image data obtained by compressiveiy coding 
a variable-size image by a prescribed method, and per- 
forms predictive decoding of the image data. 

The image predictive decoding apparatus 300 
includes a data analyzer 302, a decoder 303, and an 
adder 306. The data analyzer 302 analyzes the com- 
pressiveiy coded image data, and outputs the quantiza- 
tion width and the DCT coefficient to the line 312, the 
motion vector to the line 318, and the image size to the 
line 321 . The decoder 303 transforms the compressed 
block data (compressed block) from the data analyzer 
302 to an expanded block by data expansion. The adder 
306 adds the expanded block and the prediction block to 
generate a reproduced block. 

Further, the image predictive decoding apparatus 
300 includes a frame memory unit 309 and a prediction 
image generator 310. The frame memory unit 309 
stored the reproduced block. The prediction image gen- 
erator 310 generates an address for accessing the 
frame memory unit 309 on the basis of the motion vec- 
tor and obtains, as a prediction block, a block corre- 
sponding to the address from the image stored in the 
frame memory unit 309. In this first embodiment, the 
prediction image generator 310 decides, as a reference 
image, a single reproduced image which has been 
recently reproduced and includes significant image data 
to be referred to, on the basis of the image size from the 
data analyzer 302. The decision of a reference image 
may be carried out, as shown by dotted lines in figure 3, 
by using a controller 320 that controls the frame mem- 
ory unit 309 according to the image size from the data 
analyzer 302. That is, the frame memory unit 309 is 
controlled by the controller 320 so as to select a single 
reproduced image which has been recently reproduced 
and includes significant image data to be referred to. 

The decoder 303 comprises an inverse quantizer 
304 that inversely quantizes the compressed block from 
the data analyzer 302, and an inverse discrete cosine 
transformer (hereinafter referred to as IDCT) 305 that 
performs inverse DCT (transformation of a frequency 
region signal to a spatial region signal) to the output 
from the inverse quantizer 304. 

Further, reference numerals 301 and 307 designate 
an input terminal and an output terminal of the image 
predictive decoding apparatus 300. 

A description is given of the operation of the image 
predictive decoding apparatus shown in figure 3. 

First of all, image data (coded data) obtained by 
compressiveiy coding a variable-size image in a pre- 
scribed method is input to the input terminal 301 . In this 
first embodiment, compressive coding is carried out 
using motion compensation DCT as in MPEG1, so that 
the coded data includes the motion vector, quantization 
width, DCT coefficient, and data of image size. 

Next, in the data analyzer 302, the compressiveiy 
coded image data is analyzed, and the quantization 
width and the DCT coefficient are transmitted, as com- 



pressed block data, through the line 312 to the decoder 
303. Further, the motion vector analyzed in the data 
analyzer 302 is transmitted through the line 318 to the 
prediction image generator 310. Likewise, the image 
s size analyzed by the data analyzer 302 is transmitted 
through the like 321 to the controller 320. 

In the decoder 303. the compressed block data, i.e., 
compressed block, are expanded by the inverse quan- 
tizer 304 and the inverse DCT transformer 305, thereby 
10 generating an expanded block 314. To be specific, the 
inverse quantizer 304 inversely quantizes the com- 
pressed block, and the inverse DCT transformer 305 
transforms the frequency area signal to the spatial area 
signal, thereby generating the expanded block 314. In 
15 the prediction image generator 310, according to the 
motion vector transmitted through the line 318, an 
address 321 for accessing the frame memory unit 309 is 
generated, and this address 321 is input to the frame 
memory unit 309. Then, a prediction block 317 is gener- 
ic ated from images stored in the frame memory unit 309. 
The prediction block 317 (319) and the expanded block 
314 are input to the adder 306. wherein these blocks 
319 and 314 are added, thereby generating a repro- 
duced block 315. The reproduced block 315 is output 
25 from the output terminal 307 and, simultaneously, it is 
transmitted through the line 316 and stored in the frame 
memory unit 309. When intra-frame decoding is carried 
out, the sample values of the prediction block are all 
zero. 

30 The operation of the prediction image generator 
310 is identical to that already described with respect to 
the flowchart of figure 1 . That is, the size of the refer- 
ence image is input to the prediction image generator 
310, and the reference image is decided in the predic- 

35 tion image generator 310. The decision of the reference 
image may be carried out by controlling the frame mem- 
ory unit 309 according to information whether the size of 
the reference image is zero or not, which information is 
transmitted through the controller 320 and the line 322. 

40 Figure 4 is a block diagram illustrating a frame 
memory bank 406 as an example of the frame memory 
unit 309 in the image predictive decoding apparatus 300 
according to the first embodiment. The frame memory 
bank 406 includes three frame memories 401-403. The 

45 reproduced image is stored in one of the frame memo- 
ries 401-403. When generating a prediction image, 
these frame memories 401-403 are accessed. 

In this first embodiment, the frame memory bank 
406 has switches 404 and 405. The switch 405 is to 

so select a frame memory for storing the reproduced 
image which is input through the line 408 (correspond- 
ing to the line 316 in figure 3), from the frame memories 
401-403. The switch 405 selects the frame memories 
401-403 one by one. controlled by the controller 320, 

55 i.e. . according to the control signal 322. That is, after the 
first reproduced image is stored in the frame memory 
401, the second reproduced image is stored in the 
frame memory 402. After the third reproduced image is 
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stored in the frame memory 403, the switch 405 selects 
the frame memory 401. The switch 404 is connected 
through the line 407 (corresponding to the line 317 in 
figure 3) to the prediction image generator 310. Also this 
switch 404 selects the frame memories 401 -403 one by 
one, controlled by the controller 320, i.e., according to 
the control signal 322. However, the switching order is 
changed according to the size of the reference image. 
For example, although the switch 404 is to be connected 
to the frame memory 402 for generation of a prediction 
image according to the given order, when the image 
size of the frame memory 402 is zero, the controller 320 
controls the switch 404 so as to select the previous 
frame memory 401 (on the premise that the image size 
of the frame memory 401 is not zero). In this way, a pre- 
diction image can be generated from a reference image 
of which size is not zero. The switch 404 may be con- 
nected to plural frame memories at the same time. Fur- 
ther, in a unit where each frame memory is reset at 
every reproduction of a single image, a recently repro- 
duced image of which size is not zero can be left in the 
frame memory by controlling the unit with the controller 
320 so that the frame memory is not reset when the size 
of the reproduced image is zero. In other words, it is 
possible to prevent the frame memory from being 
updated. 

While in this first embodiment the block by block 
motion compensation DCT method is described, the 
present invention is applicable to other prediction meth- 
ods using, for example, global motion compensation or 
arbitrary lattice-shaped block motion compensation. 
Further, although in this first embodiment a prediction 
image is generated from a single reproduced image 
serving as a reference image, the present invention is 
similarly applicable to the case where a prediction 
image is generated from plural reference images. 

As described above, according to the first embodi- 
ment of the invention, the size of a previous reference 
image which is input to the apparatus is detected and, 
when the size of the reference image is not zero, a pre- 
diction image is generated using the reference image. 
On the other hand, when the size of the previous refer- 
ence image is zero, a prediction image is generated 
using a recently reproduced image of which size is not 
zero. Therefore, when plural objects constituting an 
image are subjected to compressive coding and trans- 
mitted object by object to increase the compression effi- 
ciency, it is avoided that a variable-size image which has 
already disappeared is used as a reference image for 
predictive decoding or coding, resulting in appropriate 
predictive decoding or coding capable of suppressing 
the residual signal (difference signal). Further, the 
coded data obtained by the image predictive coding 
apparatus according to this seventh embodiment can be 
decoded correctly by the image predictive decoding 
apparatus according to the second embodiment. 



[Embodiment 2] 

In the first embodiment of the invention, it is 
detected whether the size of the reference image is zero 

5 or not, and the reference image is decided using the 
detected information. However, when the fact that the 
image size is zero is shown by another index (e.g., one- 
bit flag F), control can be carried out using this index. In 
this second embodiment of the invention, generation of 

10 a prediction image is controlled using such index. 

That is, in this second embodiment, as shown in fig- 
ure 9. coded data of an object image includes a one-bit 
flag F showing that the image size is zero, i.e., the cor- 
responding reference image is completely transparent 

is and has no coded data, and this flag F is placed before 
the horizontal and vertical sizes Hm and Vm showing 
the image size. When the image size is zero, the flag F 
is "0". In this second embodiment, generation of a pre- 
diction image is controlled using the flag F. 

20 Hereinafter, a description is given of a prediction 
image generation process in the image predictive 
decoding method according to the second embodiment, 
using the flowchart of figure 8. 

To generate a prediction image, initially, a previous 

25 reference image is input in step 802, and it is examined 
in step 803 whether the flag F of the reference image is 
"1 " or not. When it is decided in step 803 that the flag F 
of the reference image is "1". the size of this reference 
image is not zero, namely, the reference image is not 

30 completely transparent and has coded data. So, in step 
804, a prediction image is generated using the previous 
reference image. 

When it is decided in step 803 that the flag F of the 
reference image is not "1", step 805 follows, wherein a 

35 prediction image is generated using, as a reference 
image, a recently reproduced image of which flag F is 
not'O". 

As described above, according to the second 
embodiment of the invention, when plural objects con- 

40 stituting an image are subjected to compressive coding 
and transmitted object by object, it is avoided that a var- 
iable-size image which has already disappeared is used 
as a reference image, resulting in appropriate predictive 
decoding or coding capable of suppressing the residual 

45 signal (difference signal). In addition, the coded data of 
the object image has, at its head, a flag showing 
whether or not the previously reproduced image has 
significant coded data to be referred to, and the refer- 
ence image is decided by detecting this flag. So, the 

so operation of deciding the reference image is facilitated. 

[Embodiment 3] 

Figure 5 is a flowchart of a prediction image gener- 
55 ation process in an image predictive decoding method 
according to a third embodiment of the present inven- 
tion. The prediction image generation process accord- 
ing to this third embodiment is fundamentally identical to 
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that according to the first embodiment except that step 
505 in figure 5 takes the place of step 1 05 in figure 1 . In 
step 505, when the reference image is zero or when the 
reference image is completely transparent (or when the 
flag F of the image is "0"). a prediction image to which a $ 
prescribed value is assigned, i.e., a prediction image 
having a prescribed value, is generated. 

In this third embodiment, it is assumed that the pre- 
diction image is gray, i.e., both the luminance signal 
value and the color difference signal value thereof are 10 
128. As a result, when coding, the gray block is sub- 
tracted from the block being an object of coding. When 
decoding, the gray block is added to the block being an 
object of decoding. The prescribed value mentioned 
above may be variable, and this value may be transmit- is 
ted from the encoder to the decoder to be used for gen- 
erating a prediction image. 

As described above, according to the third embodi- 
ment of the invention, when plural objects constituting 
an image are subjected to compressive coding and 20 
transmitted object by object, it is avoided that a variable- 
size image which has already disappeared is used as a 
reference image, resulting in appropriate predictive 
decoding or coding capable of suppressing the residual 
signal (difference signal). Further, when the size of the 25 
reference image is zero. i.e.. when the reference image 
is completely transparent, a prediction image having a 
prescribed value is generated. Therefore, in addition to 
the same effects as provided by the first embodiment, 
generation of the prediction image is facilitated. 30 

[Embodiment 4] 

Figure 1 0 is a flowchart of a prediction image gen- 
eration process in an image predictive decoding method 35 
according to a fourth embodiment of the present inven- 
tion. The prediction image generation process accord- 
ing to this fourth embodiment is fundamentally identical 
to that according to the second embodiment except that 
step 1 005 in figure 1 0 takes the place of step 805 in fig- 40 
ure 8. In step 1005, when the flag F of the reference 
image is "0", a prediction image to which a prescribed 
value is assigned, i.e., a prediction image having a pre- 
scribed value, is generated. 

According to the fourth embodiment of the inven- 45 
tion, when plural objects constituting an image are sub- 
jected to compressive coding and transmitted object by 
object, it is avoided that a variable-size image which has 
already disappeared is used as a reference image, 
resulting in appropriate predictive decoding or coding so 
capable of suppressing the residual signal (difference 
signal). Further, the coded data of the object image has, 
at its head, a flag showing whether or not the previously 
reproduced image has significant coded data to be 
referred to. and when it is detected that this flag is "0", a 55 
prediction image having a prescribed value is gener- 
ated. Therefore, in addition to the same effects as pro- 
vided by the second embodiment, generation of the 



prediction image is facilitated. 

[Embodiment 5] 

Figure 6 is a flowchart of a prediction image gener- 
ation process in an image predictive decoding method 
employing bidirectional prediction, according to a fifth 
embodiment of the present invention. Hereinafter, a 
description is given of the bidirectional prediction proc- 
ess in the case where the reference image size is zero, 
i.e., when the reference image is completely transpar- 
ent. 

Initially, in step 602, the sizes of forward and back- 
ward reference images are input. The image #5 (205) 
shown in figure 2(a) is a bidirectional prediction image 
of which forward reference image and backward refer- 
ence image are the image #4 (204) and the image #6 
(206), respectively. 

When it is decided in steps 603 and 604 that the 
sizes of both the forward and backward reference 
images are zero, an image to which a prescribed value 
is assigned, i.e., an image having a prescribed value, is 
generated as a prescribed value in step 605. 

When it is decided in steps 603 and 604 that the 
size of the forward reference image is zero and the size 
of the backward reference image is not zero, a predic- 
tion image is generated using only the backward refer- 
ence image in step 606. 

When it is decided in steps 603 and 607 that the 
size of the forward reference image is not zero and the 
size of the backward reference image is zero, a predic- 
tion image is generated using only the forward refer- 
ence image in step 608. 

When it is decided in steps 603 and 607 that the 
sizes of both the forward and backward reference 
images are not zero, a prediction image is generated 
using these reference images. 

In step 610, the generated prediction image is out- 
put. Receiving the prediction image, the encoder sub- 
tracts the prediction image from the object image, while 
the decoder adds the prediction image to the difference 
of the object image. In this way, the residual signal (dif- 
ference signal) can be suppressed. 

As described above, according to the fifth embodi- 
ment of the invention, in the case where plural objects 
constituting an image are subjected to compressive 
coding and transmitted object by object, when a predic- 
tion image is generated using forward and backward 
reference images, it is avoided that variable-size images 
which have already disappeared are used as the refer- 
ence images, resulting in appropriate predictive decod- 
ing or coding capable of suppressing the residual signal 
(difference signal). Further, since a prediction image 
having a prescribed value is generated, generation of 
the prediction image is facilitated. 
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[Embodiment 6] 

Figure 11 is a flowchart of a prediction image gen- 
eration process in a predictive decoding method using 
bidirectional prediction, according to a sixth embodi- 
ment of the present invention. This sixth embodiment is 
fundamentally identical to the fifth embodiment, in like 
manner that the second and fourth embodiments are 
fundamentally identical to the first and third embodi- 
ments, respectively. To be specific, in this sixth embodi- 
ment, "size is zero ?" in steps 603, 604 and 607 in figure 
6 are changed to "flag F is 0 T as shown in steps 1 103, 
1104 and 11 07 in figure 11. 

According to the sixth embodiment of the invention, 
in the case where plural objects constituting an image 
are subjected to compressive coding and transmitted 
object by object, when a prediction image is generated 
using forward and backward reference images, it is 
avoided that variable-size images which have already 
disappeared are used as the reference images, result- 
ing in appropriate predictive decoding or coding capable 
of suppressing the residual signal (difference signal). 
Further, when it is detected that the flags F of the for- 
ward and backward reference images are "0", a predic- 
tion image having a prescribed value is generated. 
Therefore, detection of the variable-size image which 
has already disappeared is facilitated, and generation of 
the prediction image is facilitated. 

[Embodiment 7] 

Figure 12 is a block diagram illustrating an image 
predictive coding apparatus 1000 according to a sev- 
enth embodiment of the present invention. The coding 
apparatus 1000 comprises a texture coding unit 1100 
that performs predictive coding of a texture signal com- 
prising a luminance signal and a color difference signal, 
and a shape coding unit 1200 that performs predictive 
coding of a shape signal. 

The texture coding unit 1100 comprises a blocking 
unit 1110 that divides a texture signal per frame into plu- 
ral macroblocks each having the size of 16x16 pixels (a 
unit subjected to coding) and outputs the divided texture 
signal; a subtracter 1160 that calculates a difference 
between a block being an object of coding (hereinafter, 
referred to as an object block) and a prediction block 
corresponding to the object block; a compressive 
encoder 1 120 that compressively codes the difference; 
and a local decoder 1 130 that expansively decodes the 
output from the compressive encoder 1 120. The com- 
pressive encoder 1120 comprises a discrete cosine 
transformer. (hereinafter referred to as a DCT) 1 121 that 
performs discrete cosine transformation (DCT) of the 
difference, and a quantizer 1 122 that quantizes the DCT 
coefficient. The local decoder 1130 comprises an 
inverse quantizer 1 131 that inversely quantizes the out- 
put from the quantizer 1122, and an inverse discrete 
cosine transformer (hereinafter referred to as an I DCT) 



1132 that performs inverse DCT (transformation of a 
frequency region signal to a spatial region signal) to the 
output from the inverse quantizer 1 131 . 

Further, the texture coding unit 1100 includes an 

s adder 1170 that adds an expanded block output from 
the IDCT 1132 and the prediction block to generate a 
reproduced block; a frame memory unit (FM 1 ) 1 1 40 that 
stores the reproduced block; and a prediction image 
generator 1150 that obtains a prediction bock corre- 

io sponding to the object block from images stored in the 
frame memory unit 1140 by motion compensation on 
the basis of motion information detected by a prescribed 
motion detection method. 

The prediction image generator 1 150 decides a ref- 

75 erence image to be referred to when generating a pre- 
diction block (prediction image) from the reproduced 
images stored in the frame memory unit 1 1 40 on the 
basis of the image size obtained from the output of the 
blocking unit 1 1 10. 

20 On the other hand, the shape coding unit 1200 
comprises a blocking unit 1210 that divides a shape sig- 
nal per frame into plural macroblocks each having the 
size of 1 6x1 6 pixels (a unit subjected to coding) and out- 
puts the divided shape signal; a subtracter 1260 that 

25 calculates a difference between a block being an object 
of coding (object block) and a prediction block corre- 
sponding to the object block; a shape encoder 1220 that 
codes the difference by a prescribed coding method; 
and a shape decoder 1 230 that decodes the output from 

30 the shape encoder 1220 by a decoding method corre- 
sponding to the coding method. The shape encoder 
1120 codes the output from the subtracter 1260 by a 
coding method such as quarter tree or chain coding. 
The shape coding unit 1200 further comprises an 

35 adder 1270 that adds a decoded block output from the 
shape decoder 1230 and the prediction block to gener- 
ate a reproduced block; a frame memory unit (FM2) 
1240 that stores the decoded block output from the 
adder 1270; and a prediction image generator 1250 that 

40 obtains a prediction block corresponding to the object 
block from the shape information stored in the frame 
memory unit 1240 by motion compensation based on 
the motion information detected by a prescribed motion 
detection method. 

45 Further, the prediction image, generator 1250 
decides a reference image to be referred to when gen- 
erating a prediction block (prediction image), from the 
reproduced images stored in the frame memory unit 
1240, on the basis of the image size obtained from the 

so output of the blocking unit 1 21 0. 

The decision of the reference image by the coding 
unit 1 100 or 1200 may be carried out, as shown by dot- 
ted lines in figure 12, by using a shape detector 1280 
that performs shape detection on the basis of the repro- 

55 duced block, and controlling the frame memory units 
1140 and 1240 according to the result of shape detec- 
tion which is output from the shape detector 1280. In 
this case, the control of the frame memory units accord- 
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ing to the result of shape detection is identical to the 
control of the frame memory unit 309 by the controller 
320 according to the first embodiment. Further, the 
result of shape detection is applied to a variable-length 
encoder 1010 which is described later, and transmitted 5 
together with coded data of the texture signal and the 
shape signal. 

Further, the image predictive coding apparatus 
1000 includes a variable-length encoder 1010. The var- 
iable-length encoder 1010 performs variable-length 10 
coding of the coded texture signal output from the tex- 
ture encoder 11 00 and the coded shape signal and the 
result of shape detection, which are output from the 
shape encoder 1200, and multiplexes these signals to 
be output. 15 

In figure 12, reference numeral 1001 denotes an 
input terminal for the texture signal, 1002 denotes an 
input terminal for the shape signal, and 1003 denotes 
an output terminal for the coded data. 

A description is given of the operation. 20 

When a texture signal (luminance/color-difference 
signals) and a shape signal are input to the image pre- 
dictive coding apparatus 1000, the texture signal and 
the shape signal are divided into macroblocks (units 
subjected to coding) by the blocking units 1110 and 25 
1210 included in the coding units 1100 and 1200, 
respectively, and prediction coding is carried out for 
each macroblock. 

In the texture signal coding unit 1100, the sub- 
tracter 1 160 calculates a difference between an object 30 
block and a prediction block, the DCT 1121 transforms 
this difference to a DCT coefficient, and the quantizer 
1 122 quantizes the DCT coefficient to generate a quan- 
tized coefficient. The quantized coefficient is output 
toward the variable-length encoder 1010. 35 

The inverse quantizer 1131 inversely quantizes the 
quantized coefficient to generate a DCT coefficient, and 
the IDCT 1130 transforms the DCT coefficient to an 
expanded block corresponding to the object block by a 
process of transforming frequency region data to spatial 40 
region data. Further, the adder 1 1 70 adds the expanded 
block and the prediction block to generate a reproduced 
block. The reproduced block is stored in the frame 
memory unit 1140. At this time, the prediction image 
generator 1 1 50 generates a prediction block corre- 45 
sponding to the object block, from the images stored in 
the frame memory unit 1140, by motion compensation 
on the basis of motion information detected by a pre- 
scribed motion detection method. Further, the predic- 
tion image generator 1150 decides, as a reference so 
image, a single reproduced image which has been 
recently reproduced and includes significant image data 
to be referred to, from the reproduced images stored in 
the frame memory unit 1140. When the apparatus is 
provided with the shape detector 1280, the decision of ss 
the reference image can be performed by controlling the 
frame memory unit 1140 according to the output from 
the shape detector 1280, i.e., information whether the 
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size of the reproduced image to be referred to is zero or 
not. 

In parallel with the processing of the texture 
encoder 1100, in the shape encoder 1200, predictive 
coding of the shape signal is carried out in similar man- 
ner to the above-described predictive coding of the tex- 
ture signal. That is, a difference between the object 
block and the prediction block is obtained by the sub- 
tracter 1260, and this difference is coded by a coding 
method such as quarter tree or chain coding in the 
shape encoder 1220, and the coding result is output 
toward the variable-length encoder 1010. Further, the 
coded shape signal from the shape encoder 1220 is 
restored by the shape decoder 1230, and the restored 
block and the prediction block are added by the adder 
1270 to generate a reproduced block. 

The reproduced block output from the adder 1270 
is stored in the frame memory unit 1240. In the predic- 
tion image generator 1250, a prediction block corre- 
sponding to the object block is generated from the 
shape information stored in the frame memory unit 
1240, by motion compensation based on motion infor- 
mation detected by a prescribed motion detection 
method. Further, in the prediction image generator 
1250, a single reproduced image which has been 
recently reproduced and includes significant image data 
to be referred to is decided as a reference image, from 
the reproduced images stored in the frame memory unit, 
1240, on the basis of the image size obtained from the 
output of the blocking unit 1210. 

When the apparatus is provided with the shape 
detector 1 280, the decision of the reference image can 
be performed by controlling the frame memory unit 
1240 according to the output from the shape detector 
1280, i.e., information whether the size of the repro- 
duced image to be referred to is zero or not. In this case, 
the reproduced block is input to the shape detector 
1280 wherein shape detection is carried out. For exam- 
ple, assuming that the shape signal is a binary signal, 
when there is only black data between white data and 
black data as shape data, no reproduced data exists. At 
this time, there is no texture signal corresponding to the 
shape signal of this block. In this case, as described 
above, a flag showing "no coded data" or data showing 
"image size is zero" is output from the shape detector 
1280 toward the frame memory units 1140 and 1240 
and the variable-length encoder 1010. In the frame 
memory units 1140 and 1240, according to the output 
from the shape detector 1280, control is carried out in 
similar manner to the control of the frame memory unit 
309 by the controller 320 according to the first embodi- 
ment. 

As described above, according to the seventh 
embodiment of the present invention, in the coding unit 
1 100 (1200). a single reproduced signal which has been 
recently reproduced and includes significant image data 
to be referred to is decided as a reference image from 
the reproduced images stored in the frame memory unit 
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1 140 (1210) according to the image size obtained from 
the output of the blocking unit 1110 (1210). Therefore, 
when plural objects constituting an image are subjected 
to compressive coding and transmitted object by object, 
it is avoided that a variable-size image which has 
already disappeared is used as a reference image for 
predictive coding, whereby appropriate predictive cod- 
ing that can suppress the residual signal (difference sig- 
nal) is carried out. Further, the coded data obtained by 
the image predictive coding apparatus according to this 
seventh embodiment can be decoded correctly by the 
image predictive decoding apparatus according to the 
second embodiment 

Further, when the apparatus includes the shape 
detector 1280, the decision whether a reference image 
corresponding to the input object block exists or not is 
performed by detecting the shape of the reproduced 
block of the shape signal, in the shape coding unit 1 200. 
When the reproduced block has no shape, in the texture 
encoder and the shape encoder, a prediction block is 
generated using a reproduced block which has been 
recently reproduced and has a shape, instead of the 
reproduced block corresponding to the object block. 
Therefore, when plural objects constituting an image 
are subjected to compressive coding and transmitted 
object by object, it is avoided that a variable-size image 
which has already disappeared is used as a reference 
image for predictive coding, whereby appropriate pre- 
dictive coding is carried out. Also in this case, the coded 
data obtained by the image predictive coding apparatus 
according to this seventh embodiment can be decoded 
correctly by the image predictive decoding apparatus 
according to the second embodiment. That is, in the 
image predictive decoding apparatus, the data analyzer 
302 controls the frame memory unit 309 on the basis of 
the output from the shape detector 1280. Therefore, 
when coded data obtained by object by object predictive 
coding is decoded, it is avoided that a variable-size 
image which has already disappeared is used as a ref- 
erence image for predictive decoding, whereby appro- 
priate predictive decoding is carried out. 

In this seventh embodiment, the selection of the 
reproduced image as a reference image by the predic- 
tion image generator 1150 (1250) or the control of the 
frame memory unit 1140 (1240) according to" the result 
of shape detection is carried out in the same manner as 
the selection of the reproduced image as a reference 
image by the prediction image generator 1 150 (1250) or 
the control of the frame memory unit 309 by the control- 
ler 320 according to the first embodiment, respectively. 
However, the present invention is not restricted thereto. 

For example, when there is no image data to be 
referred to in a frame previous to the object frame, a 
prediction image having a prescribed value may be gen- 
erated as described for the third embodiment. In this 
case, as an image predictive decoding apparatus corre- 
sponding to the image predictive coding apparatus, an 
apparatus that performs the image predictive decoding 



process according to the third embodiment is employed. 

Further, the prediction according to this seventh 
embodiment may be bidirectional prediction as 
described for the fifth embodiment. In this case, as an 
5 image predictive decoding apparatus corresponding to 
the image predictive coding apparatus, an apparatus 
that performs the image predictive decoding process 
according to the fifth embodiment is employed. 

10 [Embodiment 8] 

Figure 13 is a block diagram illustrating an image 
predictive coding apparatus 1000a according to an 
eighth embodiment of the present invention. The coding 

75 apparatus 1 000a comprises a texture coding unit 1 1 00a 
that performs predictive coding of a texture signal com- 
prising a luminance signal and a color difference signal, 
and a shape coding unit 1200a that performs predictive 
coding of a shape signal. 

20 The texture coding unit 1 100a is different from the 
texture coding unit 1100 according to the seventh 
embodiment only in that a switch 1190 is connected 
between the input terminal 1001 and the blocking unit 
1110, which switch connects (supplies) the texture sig- 

25 nal to either of the blocking unit 1110 and the ground, 
according to a control signal. 

The shape coding unit 1200a is different from the 
shape coding unit 1200 according to the seventh 
embodiment only in that it does not include the shape 

30 detector 1280, and a switch 1290 is connected between 
the input terminal 1002 and the blocking unit 1210, 
which switch connects (supplies) the shape signal to 
either of the blocking unit 1210 and the ground, accord- 
ing to a control signal. 

35 The image predictive coding apparatus 1000a fur- 
ther includes a shape detector 1020 that receives the 
shape signal and outputs the result of shape detection 
toward the switches 1 190 and 1290 as the control sig- 
nal. When it is detected by the shape detector 1020 that 

40 the input shape signal has no shape, the switch 1190 
(1290) connects the texture signal (shape signal) to the 
ground. Conversely, when the input shape signal has a 
shape, the switch 1 190 (1290) connects the texture sig- 
nal (shape signal) to the blocking unit 1 1 10 (1210). The 

45 result of shape detection is subjected to variable-length 
coding by the variable-length encoder 1010, together 
with the coded data from the coding units 1100a and 
1200a. 

A description is now given of the operation of the 
so image predictive coding apparatus 1000a according to 
this eighth embodiment. The operation of the apparatus 
1000a is identical to the operation already described for 
the seventh embodiment except that the switches 1 190 
and 1290 are controlled by the shape detector 1020. 
55 To be specific, when the texture signal and the 
shape signal are input, the shape detector 1020 detects 
whether the input shape signal has a shape or not. 
When the shape signal does not have a shape, the 
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switches 1190 and 1290 are controlled by the output 
from the shape detector 1 020 so that the texture signal 
and the shape signal are supplied to the ground. That is, 
at this time, the texture signal and the shape signal are 
not subjected to predictive coding, and the result of 
shape detection by the shape detector 1 020 is supplied 
to the variable-length encoder 1010. 

On the other hand, when it is detected that the input 
shape signal has a shape, the switches 1 190 and 1290 
are controlled by the output from the shape detector 
1020, and the texture signal and the shape signal are 
input to the blocking units 1110 and 1210, respectively, 
wherein these signals are subjected to predictive cod- 
ing. The result of shape detection by the shape detector 
1020 is supplied to the variable-length encoder 1010, 
together with the outputs from the coding units 1100a 
and 1200a. 

As described above, according to the eighth 
embodiment of the present invention, the image predic- 
tive coding apparatus includes the shape detector 1020 
that detects whether the input shape signal has a shape 
or not. When the shape signal has a shape, the texture 
signal and the shape signal are subjected to predictive 
coding, and when the shape signal does not have a 
shape, the texture signal and the shape signal are not 
subjected to predictive coding. Therefore, when plural 
objects constituting an image are subjected to compres- 
sive coding and transmitted object by object, it is 
avoided that a variable-size image which has already 
disappeared is used as a reference image for predictive 
coding, whereby appropriate predictive coding that can 
suppress the residual signal (difference signal) is car- 
ried out. 

Further, since the result of shape detection by the 
shape detector 1020 is coded and transmitted, an 
image predictive decoding apparatus that receives the 
result of shape detection can appropriately perform pre- 
diction decoding of a variable-size image that has 
already disappeared, using the result of shape detec- 
tion as a synchronous signal. That is, while the variable- 
size image disappears, reproduction of coded data cor- 
responding to this image is stopped. 

Furthermore, when a program for implementing the 
image predictive decoding method (apparatus) or the 
image predictive coding method (apparatus) according 
to any of the aforementioned embodiments of the inven- 
tion is recorded in a storage medium such as a floppy 
disk, the image processing according to the embodi- 
ment can be executed easily in an independent compu- 
ter system. 

Figures 14(a)- 14(c) are diagrams for explaining the 
case where the image predictive decoding process or 
the image predictive coding process according to any of 
the aforementioned embodiments is executed by a com- 
puter system using a floppy disk which contains a pro- 
gram corresponding to the process. 

Figure 14(a) shows a front view of a floppy disk FD, 
a cross-sectional view thereof, and a floppy disk body D 



as a storage medium. Figure 14(b) shows an exampfe 
of a physical formation of the floppy disk body D. The 
floppy disk body D is contained in a case FC. On the 
surface of the disk body D, a plurality of tracks Tr are 

5 formed concentrically from the outer circumference of 
the disk toward the inner circumference. Each track is 
divided into 16 sectors in the angular direction. There- 
fore, in the floppy disk body D containing the above- 
mentioned program, data of the program are recorded 

w on assigned regions of the floppy disk body D. 

Figure 14(c) shows the structure for record- 
ing/reproducing the program in/from the floppy disk FD, 
wherein Cs is a computer system and FDD is a floppy 
disk drive. When the program is recorded in the floppy 

75 disk FD, data of the program are written in the floppy 
disk FD from the computer system Cs through the 
floppy disk drive FDD. When the above-mentioned 
image predictive decoding process or the image predic- 
tive coding process is constructed in the computer sys- 

20 tern Cs from the program in the floppy disk FD, the 
program is read from the floppy disk FD by the floppy 
disk drive FDD and transmitted to the computer system 
Cs. 

Although in the above description emphasis has 
25 been placed on a data storage medium containing a 
program for performing an image predictive decoding 
process or an image predictive coding process accord- 
ing to any of the aforementioned embodiments, a data 
storage medium containing coded image data accord- 
so ing to any of the aforementioned embodiments is also 
within the scope of the invention. 

Furthermore, although in the above description 
emphasis has been placed on image processing by a 
computer system using a floppy disk as a data storage 
35 medium, similar image processing can be carried out 
using other storage media, such as an IC card and a 
ROM cassette, as long as the program of the image 
processing can be recorded in the media. 

40 Claims 

1. An image predictive decoding method (Fig.1) in 
which image data obtained by compressive! y cod- 
ing a variable-size image using a prescribed 

45 method is input, a prediction image is generated 
using, as a reference image, at least one repro- 
duced image which has been reproduced before an 
image being an object of decoding, and the object 
image is subjected to predictive decoding: 

so wherein said prediction image is generated 

using, as a reference image, at least one repro- 
duced image which has been recently reproduced 
and includes significant image data to be referred 
to. 

55 

2. An image predictive decoding method (Hg.5) in 
which image data obtained by compressively cod- 
ing a variable-size image using a prescribed 
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" method is input, a prediction image is generated 
using, as a reference image, a prescribed image 
which has been reproduced before an image being 
an object of decoding, and the object image is sub- 
jected to predictive decoding: 5 

wherein, when said reproduced image used 
as a reference image has no significant coded data 
to be referred to, an image having a prescribed 
value as its image data is used as said prediction 
image. 10 

3. An image predictive decoding method (Fig.8 or 10) 
according to any of claims 1 and 2 wherein each 
frame of said compressively coded image data has 

a flag that shows whether or not a frame previous to is 
an object frame being an object of decoding 
includes significant image data to be referred to. 

4. An image predictive decoding method (Fig. 6) in 
which image data obtained by compressively cod- 20 
ing a variable-size image using a prescribed 
method is input, a prediction image is generated 
using a reference image, and an image being an 
object of decoding is subjected to predictive decod- 
ing: 25 

wherein said prediction image is generated 
using, as said reference image, at least one of two 
reproduced signals which have been recently 
reproduced, which one has significant image data 
to be referred to. so 

5. An image predictive decoding method (Fig.11) 
according to claim 4 wherein each frame of said 
compressively coded image data has two flags that 
show whether or not prescribed two frames previ- 35 
ous to an object frame being an object of decoding 
include significant image data to be referred to. 

6. An image predictive decoding apparatus (Figs.3 & 

1) comprising: 40 
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image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
examines whether or not the reproduced image 
includes significant image data to be referred 
to, and generates a prediction image using, as 
a reference image, at least one reproduced 
image which has been recently reproduced 
and includes significant image data. 

7. An image predictive decoding apparatus (Figs.3 & 

5) comprising: 

input means (301) to which image data 
obtained by compressively coding a variable- 
size image using a prescribed method is 
applied; 

a data analyzer (302) which analyzes the 
image data and outputs the image size and the 
image transform coefficient; 
a decoder (303) which restores the image 
transform coefficient to an expanded difference 
image using a prescribed method; 
a frame 'memory (309) that contains a repro- 
duced image; 

a prediction image generator (310) that gener- 
ates a prediction image using, as a reference 
image, a prescribed reproduced image stored 
in the frame memory and corresponding to the 
input image; and 

an adder (306) that generates a reproduced 
image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
examines whether or not the prescribed repro- 
duced image has significant image data to be 
referred to, and when the reproduced image 
has no significant coded data to be referred to, 
an image having a prescribed value as its 
image data is used as said prediction image. 

8. An image predictive decoding apparatus (Fig.8 or 
10) according to any of claims 6 and 7 wherein 
each frame of said compressively coded image 
data has a flag that shows whether or not a frame 
previous to an object frame being an object of 
decoding includes significant image data to be 
referred to. 

9. An image predictive decoding apparatus (Figs.3 & 

6) comprising: 



input means (301) to which image data 
obtained by compressively coding a variable- 
size image using a prescribed method is 
applied; 45 
a data analyzer (302) which analyzes the 
image data and outputs the image size and the 
image transform coefficient; 
a decoder (303) which restores the image 
transform coefficient to an expanded difference so 
image using a prescribed method; 
a frame memory (309) that contains a repro- 
duced image; 

a prediction image generator (310) that gener- 
ates a prediction image using, as a reference ss 
image, the reproduced image stored in the 
frame memory; and 

an adder (306) that generates a reproduced 
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input means (30 1 ) to which image data 
obtained by compressive! y coding a variable- 
size image using a prescribed method is 
applied; 

a data analyzer (302) which analyzes the 5 
image data and outputs the image size and the 
image transform coefficient; 
a decoder (303) which restores the image 
transform coefficient to an expanded difference 
image using a prescribed method; io 
a frame memory (309) that contains a repro- 
duced image; 

a prediction image generator (310) that gener- 
ates a prediction image using the reproduced 
image stored in the frame memory as a refer- 15 
ence image; and 

an adder (306) that generates a reproduced 
image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 20 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
generates said prediction image using, as said 
reference image, at least one of two repro- 25 
duced signals which have been recently repro- 
duced, which one has significant image data to 
be referred to. 

10. An image predictive decoding apparatus (Fig. 11) 30 
according to claim 9 wherein each frame of said 
compressiveiy coded image data has two flags that 
show whether or not prescribed two frames previ- 
ous to an object frame being an object of decoding 
include significant image data to be referred to. 35 

11. An image predictive coding method (Fig.1) in which 
a variable-size image is input, a prediction image is 
generated using, as a reference image, at least one 
reproduced image which has been reproduced 40 
before an image being an object of coding, said 
object image is subtracted from said prediction 
image, and a difference between these images is 
compressiveiy coded by a prescribed method: 

wherein said prediction image is generated 45 
using, as a reference image, at least one repro- 
duced image which has been recently reproduced 
and includes significant image data to be referred 
to. 

50 

12. An image predictive coding method (Fig. 5) in which 
a variable-size image is input, a prediction image is 
generated using, as a reference image, a pre- 
scribed reproduced image which has been repro- 
duced before an image being an object of coding, 55 
said object image is subtracted from said prediction 
image, and a difference between these images is 
compressiveiy coded by a prescribed method: 
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wherein, when said reproduced image used 
as a reference image has no significant image data 
to be referred to, an image having a prescribed 
value as its image data is used as said prediction 
image. 

13. An image predictive coding method (Fig.8 or 10) 
according to any of claims 1 1 and 12 wherein each 
frame of said compressiveiy coded image data has 
a flag that shows whether or not a frame previous to 
an object frame being an object of decoding 
includes significant image data to be referred to. 

14. An image predictive coding method (Fig. 6) in which 
a variable-size image is input, a prediction image is 
generated using a reference image, an object 
image being an object of coding is subtracted from 
said prediction image, and a difference between 
these images is compressiveiy coded by a pre- 
scribed method: 

wherein said prediction image is generated 
using, as said reference image, at least one of two 
reproduced images which has been recently repro- 
duced and includes significant image data to be 
referred to. 

15. An image predictive coding method (Fig. 11) 
according to claim 14 wherein each frame of said 
compressiveiy coded image data has two flags that 
show whether or not prescribed two frames previ- 
ous to an object frame being an object of decoding 
include significant image data to be referred to. 

16. An image predictive coding apparatus (Figs. 12 & 1) 
comprising: 

input means (1001) to which data of a variable- 
size image is input, which data is divided into 
units subjected to coding; 
a subtracter (1160) that obtains a difference 
image between an object image being an 
object of coding and a prediction image corre- 
sponding to the object image; 
a compressive encoder (1120) that converts 
the difference image to compressed data by a 
prescribed compressive coding process; 
a variable-length encoder (1010) that performs 
variable-length coding of the compressed data 
and outputs coded data; 
an expansive decoder (1 130) that restores the 
compressed data to an expanded difference 
image by a prescribed expansive decoding 
process; 

a frame memory (1 140) that contains a repro- 
duced image: 

a prediction image generator (1150) that gen- 
erates a prediction image using the reproduced 
image stored in the frame memory as a refer- 
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ence image; and 

an adder (1170) that generates a reproduced 
image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, s 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
examines whether or not the reproduced image 
has significant image data to be referred to, io 
and generates said prediction image using, as 
a reference image, at least one reproduced 
image which has been recently reproduced 
and includes significant image data. 



1 7. An image predictive coding apparatus (Figs.1 2 & 5) 
comprising: 

input means (1001) to which data of a variable- 
size image is input, which data is divided into 20 
units subjected to coding; 
a subtracter (1160) that obtains a difference 
image between an object image being an 
object of coding and a prediction image corre- 
sponding to the object image; 25 
a compressive encoder (1120) that converts 
the difference image to compressed data by a 
prescribed compressive coding process; 
a variable-length encoder (1010) that performs 
variable-length coding of the compressed data 30 
and outputs coded data; 
an expansive decoder (1 130) that restores the 
compressed data to an expanded difference 
image by a prescribed expansive decoding 
process; 35 
a frame memory (1140) that contains a repro- 
duced image; 

a prediction image generator (1 150) that gen- 
erates a prediction image using the reproduced 
image stored in the frame memory as a refer- 40 
ence image; and 

an adder (1170) that generates a reproduced 
image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 45 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
examines whether or not the reproduced image 
has significant image data to be referred to so 
and, when the reproduced image has no signif- 
icant image data, an image having a prescribed 
value as its image data is used as said predic- 
tion image. 

55 

18. An image predictive coding apparatus (Fig.8 or 10) 
according to any of claims 16 and 17 wherein each 
frame of said coded data has a flag that shows 



whether or not a frame previous to an object frame 
being an object of coding includes significant image 
data to be referred to. 

19. An image predictive coding apparatus (Figs.1 2 & 6) 
comprising: 

input means (1 001 ) to which data of a variable- 
size image is input, which data is divided into 
units subjected to coding; 
a subtracter (1160) that obtains a difference 
image between an object image being an 
object of coding and a prediction image corre- 
sponding to the object image; 
a compressive encoder (1120) that converts 
the difference image to compressed data by a 
prescribed compressive coding process; 
a variable-length encoder (1010) that performs 
variable-length coding of the compressed data 
and outputs coded data; 
an expansive decoder (1 130) that restores the 
compressed data to an expanded, difference 
image by a prescribed expansive decoding 
process; 

a frame memory (114-0) that contains a repro- 
duced image; 

a prediction image generator (1 150) that gen- 
erates a prediction image using the reproduced 
image stored in the frame memory as a refer- 
ence image; and 

an adder (1170) that generates a reproduced 
image by adding the expanded difference 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 
stores the reproduced image into the frame 
memory; 

wherein said prediction image generator 
generates said prediction image using, as said 
reference image, at least one of two repro- 
duced signals which have been recently repro- 
duced, which one has significant image data to 
be referred to. 

20. An image predictive decoding apparatus (Fig.11) 
according to claim 23 wherein each frame of said 
coded data has two flags that show whether or not 
prescribed two frames previous to an object frame 
being an object of coding include significant image 
data to be referred to. 

21. An image predictive coding apparatus (Figs.13 & 1) 
comprising: 

input means (1001 ) to which data of a variable- 
size image is input, which data is divided into 
units subjected to coding; 
a subtracter (1160) that obtains a difference 
image between an object image being an 
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object of coding and a precfiction image corre- 
sponding to the object image; 
a compressive encoder (1120) that converts 
the difference image to compressed data by a 
prescribed compressive coding process; s 
a variable-length encoder (1010) that performs 
variable-length coding of the compressed data 
and outputs coded data; 
an expansive decoder (1 130) that restores the 
compressed data to an expanded difference 10 
image by a prescribed expansive decoding 
process; 

a frame memory (1140) that contains a repro- 
duced image; 

a prediction image generator (1 150) that gen- 75 
erates a prediction image using the reproduced 
image stored in the frame memory as a refer- 
ence image; 

an adder (1170) that generates a reproduced 
image by adding the expanded difference 20 
image and the prediction image, and outputs 
the reproduced image and, simultaneously, 
stores the reproduced image into the frame 
memory; and 

a shape detector (1020) that detects whether 25 
the reproduced image includes significant 
image data to be referred to or not, on the basis 
of shape data showing the shape of an object 
and included in the variable-size image data; 

wherein said prediction image generator 30 
receives an output from said shape detector 
and, when the reproduced image has no signif- 
icant image data, said prediction image gener- 
ator generates said prediction image using, as 
a reference image, at least one reproduced 35 
image which has been recently reproduced 
and includes significant image data. 



22. A data storage medium that contains a program for 
implementing a predictive decoding process by a 40 
computer, wherein said program is constructed so 
that said computer executes an image predictive 
decoding process of an image predictive decoding 
apparatus according to any of claims 6, 7 and 9. 

45 

23. A data storage medium that contains a program for 
implementing a predictive coding process by a 
computer, wherein said program is constructed so 
that said computer executes an image predictive 
coding process of an image predictive coding appa- so 
ratus according to any of claims 16, 17, 19 and 21 . 



24. A data storage medium that contains a program for 
implementing a predictive coding process by a 
computer, wherein said program is constructed so ss 
that said computer executes an image predictive 
coding process of an image predictive coding appa- 
ratus according to any of claims 16, 17, 19 and 21 . 
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